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Abstract — We consider spatially-coupled protograph-based 
LDPC codes for the three terminal erasure relay channel. It is ob- 
served that BP threshold value, the maximal erasure probability 
of the channel for which decoding error probability converges to 
zero, of spatially-coupled codes, in particular spatially-coupled 
MacKay-Neal code, is close to the theoretical limit for the 
relay channel. Empirical results suggest that spatially-coupled 
protograph-based LDPC codes have great potential to achieve 
theoretical limit of a general relay channel. 

I. Introduction 

Felstrom and Zigangirov constructed the time-varying peri- 
odic Low-Density Parity-Check (LDPC) convolutional codes 
from LDPC block codes |T]. Surprisingly, the LDPC convo- 
lutional codes outperform the constituent underlying LDPC 
block codes. Recently, Kudekar et al. rigorously proved such 
decoding performance improvement over binary erasure chan- 
nels (BEC) and showed that the terminated LDPC convolu- 
tional coding increases the belief propagation (BP) threshold 
up to the maximum a-priori (MAP) threshold of the underlying 
block code. This phenomenon is called threshold saturation 
IIJ. A protograph of an LDPC convolutional code can be seen 
that a spatially coupled protograph of the underlying LDPC 
code, hence Kudekar et al. named this code spatially-coupled 
protograph-based LDPC code. 

Spatially-coupled protograph-based LDPC codes, composed 
of many identical protographs coupled with their neighboring 
protographs, have recently attracted much attentions. The 
threshold saturation phenomenon is observed not only for 
the BEC, but also for general binary memoryless symmetric 
(BMS) channels [SJ. It is expected that the spatially-coupled 
protograph-based LDPC codes achieve universally the capacity 
of the BMS channels under BP decoding. Such universality is 
not possessed by polar codes ID or irregular LDPC codes |]5]- 
Depending on the channel, frozen bits need to be optimized 
for polar codes and degree distributions need to be optimized 
for irregular LDPC codes. Therefore, it is expected that the 
spatially-coupled protograph-based LDPC codes are able to 
be applied to many other problems in communications. 

Recently, Kudekar and Kasai showed empirical evi- 
dences that the BP threshold value of the spatially-coupled 
protograph-based LDPC codes is approaching the theoretical 
limit for a class of channels with memory |6 1 and the Shannon 
threshold over multiple access channels [|2|. 



MacKay-Neal (MN) codes fS") are non-systematic two-edge 
type LDPC codes 19J. The MN codes are conjectured to 
achieve the capacity of BMS channels under maximum like- 
lihood decoding. Murayama et al. ifTol and Tanaka et al. flTl 
reported the empirical evidence of the conjecture for BSC 
and AWGN channels, respectively by a non-rigorous statistical 
mechanics approach known as replica method. Recently, Kasai 
et al. have shown that spatially-coupled MN codes have the 
BP thresholds very close to the Shannon limit of the BEC 

It is naturally expected that the same phenomenon oc- 
curs also for transmission over relay channels. We propose 
spatially-coupled protograph-based LDPC and MN codes for 
DF strategy over erasure relay channels. BP decoding of 
joint use of Tanner graphs is presented, and density evolution 
analysis gives an empirical evidence that spatially-coupled 
protograph-based MN codes achieve theoretical limit of the 
erasure relay channel. 

The paper is organized as follows. Section |ll] introduces 
the erasure relay channel and the DF strategy. Section HII] 
defines spatially-coupled protograph-based LDPC and MN 
codes. Section |IV] describes the density evolution equations. 
The numerical results are presented in Section |V] The last 
section will conclude. 

II. Erasure Relay Channel 

A. Channel Model 

We show the erasure relay channel used in this paper in 
Fig. [T] The relay channel comprises of a sender node S, 
a destination node D, and a relay node R. For simplicity, 
interferences between the sender and the relay transmissions 
are not considered in this paper, therefore we can view the 
above relay channel as two separate channels. One is an 
erasure-broadcast channel from S to R and D, and the other is 
a point-to-point erasure channel from R to D. We denote that 
the erasure probabilities on the channels from S to R, from R to 
D, and from S to D by Esr. ^rd. and ego, respectively. This relay 
channel can be regarded as wireless communication network 
from the viewpoint of higher layer ITSll . 

B. Capacity of Erasure Relay Channel 
Denote the coding rate at S by R. 



called base-matrices H20I . Let us assume we are given a base- 
matrix B G (Z+)'"p^"j'. The parity-check matrix is obtained 
by replacing each entry of B(i, j) with a q x q binary matrix 
which is the sum of B(i,j)-times randomly chosen q x q 
permutation matrices over GF(2). Note that the zero entry of 
B is replaced with a qx q all-zero binary matrix. This lifting 
process of matrices keeps the weight of columns and rows the 
same. 



Fig. 1. Erasure relay channel. 

Theorem 1 (Capacity lfT3l ). The achievable rate region of the 
erasure relay channel without interferences at D is given by: 

R < min{(l - esDCsp), (1 - eso) + ^(1 - Crd)}, 

where (3 = 1 if R < 1 — e^R and /3 = Esr otherwise. Since 
the DF strategy is employed, i.e., R < 1 — Esr in this paper, 
it holds that 13 — 1. The region, therefore, becomes 



R < min{(l - esp), (1 - eg 



(1 



3)}- 



(1) 



The dashed lines in Fig. |2] represents the boundary of the 
region for fixed coding rate R = 0.5. We will define a code 
pair used at S and R in Section |III] In Section |IV| we will 
investigate the achievable region of (egp, ego) for the code pair. 



C. LDPC Coding for DF Strategy 

Let Ns and Nf, are the lengths of codes used at S and R, 
respectively. We denote the codewords sent from S and R by 
X e {0, and x' £ {0,1}^'^, respectively. We denote 
the received words at R and D from S by j/r £ {0, 1, ?}^^, 
yo £ {0, 1, ?}^^, respectively. We denote the received words 
at D from R by y' G {0, 1, ?}^«. 

Design of LDPC codes for relay channels with DF strategy 
was discussed in several papers lfT4l . lITSl . llT6l . [|T7|. The 
sender S sends a codeword x encoded by an LDPC code. The 
relay R decodes x. We assume the decoding error probability 
is arbitrary small. This is realized by capacity approaching 
codes and due to the DF strategy assumption i? < 1 — Esr- 
Then R generates x' from x using another LDPC code, x' 
is transmitted to D. D decodes the codeword x from yo and 
y'. This decoding process at D is performed by joint use of 
Tanner graphs of the two LDPC codes. 

III. Spatially-Coupled Protograph-based Codes 

In this section, we define spatially-coupled protograph- 
based LDPC and MN codes, respectively. 

A. Protograph-based Codes 

Protograph-based codes are defined by the Tanner graphs 
lifted from relatively small graphs called protographs ifTSl 
|[T9 |. Protographs are defined by non-negative integer matrices 



B. Spatially-Coupled Protograph-based Codes 

We define a spatially-coupled base-matrix B[o.l-i] from a 
given base-matrix B G (^j+'^rnpxnp ^ L be a non-negative 
integer, which is referred to as coupling number. We define 



B 



[0,L-1] 



as follows. 



Bn 



B 



[0,L-1] 



Bd Bo 



B„ 



where Bo,...,Bd G (Z+) 
matrices chosen so that 



mpXTip non-negative integer 



^B, =Bg(Z- 



+ \m„xn„ 



i=Q 

for some d. These matrices are referred to as spreading base- 
matrices. 



C. Spatially-Coupled Protograph-based (l,r, L)-regular 
LDPC Codes 

We define the base-matrix of protograph-based (Z,r)-regular 
LDPC codes as 

B^'''') :=[l^... ,l]e (Z+)l^^ 

where we assumed r — kl for some integer k, for simplic- 
ity. Spatially-coupled protograph-based (l, r, L)-regular LDPC 
codes are defined as protograph-based codes defined by 
spreading base-matrices 



B 



= G (Z+y'' forO<i</-l. 



The design rate of the spatially-coupled protograph- 

based (Z, r, L)-regular LDPC codes is given by 

Lk L 

(2) 

= 1 — 1/fc is the design rate of the underlying code, 
converges to i?*^''^) as increasing L with gap 0{1/L). 
We use bits corresponding to the leftmost column of B^''*^^ 
and Bj ' for i = 0, — 1 as information bits. 



D. Spatially-Coupled Protograph-based (I, r, g, L)-MN Codes 
We define the base-matrix of protograph-based (Z, r, (;)-MN 



codes as 

■gMN(;,r,g) 



r 1 



1 



1 



1 



where we assumed I — gr, for simplicity. MN codes have 
punctured nodes, therefore the bits corresponding to the left- 
most column of b'^^'-'''^'^'' are punctured. 

Spatially-coupled protograph-based (l,r,g,L)-MN codes 
are defined as protograph-based codes defined by spreading 



base-matrices B 



MN((, r,3) 



for i — 0, . . . , g ~ 1 as follows 



B 



MN(/,r,g) 



Oi-lxg+1 

0, 



B 



MN(/,r,g) 



Jg-iX3+l_ 

= [r - 1, Oixg-j, li] for 1 < i < g - 1, 

9-1 



^ gMN(;,r,g) _ 



MN(/,r,g) 



where Oaxb represents an a x 6 all-zero matrix and 1; 
represents an all-one row vector of length i. 

The design rate i?^^N(z,r,g,L) jj^g spatially-coupled 
protograph-based {l,r, g, L)-MN codes is given by 

{g + l)L-{gL + g-l) 



^MN(/,r,g,L) 



1 



L{g + 1)-L 



1 pMN(/,r,g) 
j^MW.r.a} _ LJl . (3) 



^MN(i, r,g) _ I / g IS the design rate of the underlying code. 
j^MN(i,r,g,L) converges to i?MN(!,r,3) increasing L with gap 
0{1/L). 

We use bits corresponding to the leftmost column of 
BMN(/,r,g) gMNii.r.g) fyr I ^ , . . . , g - I US information 
bits. 



E. Relay Channel Coding via Spatially-Coupled Protograph- 
based Codes 



As explained in Section Hl-AI we use two LDPC codes for 
coding at S and R. We propose a relay channel coding scheme 
via spatially-coupled protograph-based codes in the following 
way. 

The sender S encodes the information bits into x with a 
spatially-coupled (Z, r, i)-regular LDPC (resp. {l,r,g, i)-MN) 
code defined by a base-matrix b|q 2* .^j (resp. b|^^*-^'[j^-'). The 
relay R decodes x from j/r and encodes the information bits 
into x' with another spatially-coupled (/, r, L)-regular LDPC 
(resp. {l,r, g, LyMN) code defined by the same base-matrix 



B 



fresD B^''^'''''^)^ 
[0,L-l] ".resp. jDj(j^^_^j ). 

The destination D decodes x from yo and y' by BP 

decoding. The BP decoding algorithm is performed on a 

Tanner graph which represents the two codes. The joint Tanner 

graph is obtained by connecting information variable nodes in 



the two codes with check nodes of degree 2. For example, the 
joint protograph of spatially-coupled (3,6,24)-regular LDPC 
and (4,2,2, 12)-MN codes are depicted in Figs. |4] and |7] 
respectively. 

IV. Density Evolution Analysis 

The BP decoder 11211 iteratively exchanges messages e 
{0, 1, ?} between variable nodes and check nodes in the Tanner 
graphs. For transmissions over the BEC, the density evolution 
allows us to predict the message erasure probability at each 
iteration round. 

Let us assume we are given two protograph-based codes 
defined by a spatially-coupled base-matrix B. We refer to the 
edges in the Tanner graph corresponding to the base-matrix 
entry B(i,j) as edges at section Let t/j- denote the 

probability that the messages from check nodes to variable 
nodes along the edges at section (i,j) are "?" at iteration i. 
Similarly, we define x] ^ as the probability that the messages 
from variable nodes to check nodes along the edges at section 
are "?" at iteration £. The messages at the 0-th round 
are initialized with channel outputs. It follows that ~ 
Ej, where ej is defined by ej — ego (reps, epo) if the bits 
are transmitted by S (resp. R) and corresponding to the j- 
th column of the base-matrix entry B are not punctured, and 
Ej ~ 1 Otherwise. 

A message sent from a check node is "?" if and only if at 
least one of the incoming messages are "?". Consequently, we 
have 



y. 



for such that B(«,j) ^ 0. 

A message sent from a variable node is "?" if all the 
incoming messages and the message from the channel are "?". 
Consequently, we have 

i' 

for such that B(i,j) ^ 0. 

The channel erasure probability pair (eRo, Esd) is said to be 
achievable by the protograph-based codes if lim^^oo j ~ 
for all i,j such that B(i, j) ^ 0. 

V. Numerical Results 

In this section, we evaluate the achievable (epo, Esd) region, 
referred to as achievable erasure probability region, for LDPC 
codes and spatially-coupled protograph-based LDPC and MN 
codes. We choose L — 128 so that the difference between 

^MN(;,r.g,L) ^jjj q 5 jg^g jj^^jj g.Ol. 

A. Regular LDPC Codes 

The joint base matrix of the joint (3,6)-regular LDPC code 
at D is given as 



B 



3 3 
3 3 
10 10 



(4) 



1.0 



1.0 



Fig. 2. Achievable erasure probability region of (3,6)-regular LDPC codes 
at S and R. The black dashed line represents the theoretical limit Eq. (T) 
for rate 0.5. It can be seen that there is a large gap in the slope region for 
0.5 < ERD < 1, 0.5 < esD < 1. 



Fig. 3. Achievable erasure probability region of accumulate repeat jagged 
accumulate (ARJA) code 1221 with split-extension technique (17|. The black 
dashed line represents the theoretical limit Eq. (T) for rate 0.5. It can be seen 
that there still remains a large gap in the slope region for 0.5 < erd < 1, 
0.5 < esD < 1. 



The 2 leftmost columns and the other columns correspond x 
and x' , respectively. Therefore = Esd for J = and 1, and 
Cji = for j' = 2 and 3. Note that the indices of matrices 
start from 0. We compute achievable erasure probability region 
using density evolution with B as shown in Eq. (|4|i. 

Figure |2] shows the achievable erasure probability region of 
(3,6)-regular LDPC codes of rate 0.5 at S and R. The vertical 
axis represents Esd ™d the horizontal axis represents epo. The 
black dashed line represents the theoretical limit Eq. (HJ for 
rate 0.5. It can be seen that there is a large gap in the slope 
region for 0.5 < epo < 1, 0.5 < < 1. 

When Erd = 1, y' is all erased, D needs to decode x only 
from yD- Hence, the achievable ego when = 1 is equal to 
the BP threshold of the (3,6)-regular LDPC code 0.4294. 



(ARJA) codes ll22l with the split-extension is given as 
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B. Split-extended LDPC codes M7\l 

Recently a split-extension technique for LDPC coding over 
the Gaussian relay channels has been developed by Savin ifTTl . 
The performance over the BEC has not been known, therefore 
we evaluate by using achievable erasure probability region for 
comparison purpose. 

Split-extension technique splits the check node of the pro- 
tograph to two or more check nodes with variable node of 
degree 2 in order to generate extra parity bits x' sent from the 
R toward the D. When generated variable nodes of degree 2 
are punctured, splitted protograph is identical to the original 
protograph. Hence R sends bits corresponding to the variable 
nodes of degree 2 to the D. The extra bits can help to decode 
the X at D. 

The base matrix of the accumulate repeat jagged accumulate 



The j-th columns j — 1,...,4 and the j'-th columns 
j' = 5, . . . , 8 and correspond x and x' , respectively. The 
leftmost column corresponds to the punctured bits of ARJA 
codes. Therefore = Esd for j — 1,2,3,4, e^v — for 
j' — 5,6,7,8, and eq — 1- Note that the indices of matrices 
start from 0. We compute achievable erasure probability region 
using density evolution with B as shown in Eq. (|5]l. 

Figure [3] shows achievable erasure probability region of 
ARJA codes with the split-extension. When = 1, y' is 
all erased, D needs to decode x only from yo- Hence, the 
achievable esD when Crd = 1 is equal to the BP threshold of 
the ARJA code 0.4387. It can be seen that there remains a gap 
in the slope region for 0.5 < e^o < 1, 0.5 < < 1. 



C. Spatially-Coupled 
LDPC Codes 



Protograph-based {I, r, L)-regular 



The joint base matrix of the spatially-coupled (3,6,128)- 
regular LDPC codes at D is given as 



B 



B 



(3,6) 



B 



(3,6) 



[0.127] "[0.127] 

I' I' 

;^128X256 ^128x256 

"1 1 ••• 110 



1111 
1111 

11 

10 
10 



1 1 
1 1 



1 



10 
10 



(6) 



where 1^28x256 ^"^^ ^ "^^^ matrix whose (j, 2j)-th entry is 
1 and the other entries are 0. These 2j-th columns correspond 
to information bits. Note that the indices of matrices start from 
0. The left 256 columns and the other correspond to x and x' , 
respectively. Therefore = Csd for j = 0, . . . , 255, and e^v = 
Erd for i' = 256,..., 511. We compute achievable erasure 
probability region using density evolution with B as shown in 
Eq. dSll. 

Figure |5] shows achievable erasure probability region of 
spatially-coupled protograph-based (3,6,128)-regular LDPC 
codes at S and R. The design rate i?(3'6,i28) 0.4921875. As L 
goes to infinity, R'-^-^'^^ converges to 0.5 as shown in Eq. (|2]l. 
The black dashed line represents the theoretical limit for rate 
0.4921875 and the gray dotted line represents the theoretical 
limit for rate 0.5. At the comer point = 1 (ego = 1), Csd 
(erd) is almost equal to the MAP threshold of (3,6)-regular 
LDPC code 0.48815. However, there is still a small gap in the 
slope region for 0.5 < eRo < 1, 0.5 < < 1. 

We omit the joint base matrix of the spatially-coupled 
(5,10,128)-regular LDPC codes at D, because it is naturally 
derived from B as shown in Eq. (|6]). Figure|6]shows achievable 
erasure probability region of spatially coupled (5,10,128)- 
regular LDPC codes at S and R. The design rate iT;(5,io,i28) 
is 0.484375. As L goes to infinity, r(5.w,l) converges to 0.5 
as shown in Eq. (|2]i. The black dashed line represents the 
theoretical limit for rate 0.484375 and the gray dotted line 
represents the theoretical limit for rate 0.5. At the comer point 
Erd = 1 (esd = 1)> EsD (crd) is almost equal to the MAP 
threshold of (5,10)-regularLDPC code 0.4995. However, there 
still remains a small gap in the slope region for 0.5 < eRo < 1, 

0. 5 < esD < 1- 

x' from R includes repetition bits of the x from S, since 
the lower part of the joint base matrix has rows of weight 2, 

1. e., [Ii28x256li28x256]- ^his repetition causes rate loss in 
the slope region, hence we don't believe that spatially-coupled 
(Z, r, L)-regular LDPC codes can achieve the theoretical limit 
of erasure relay channel. 




Fig. 4. Protograph of spatially-coupled protograph-based (3,6,24)-regular 
LDPC codes. The lower protograph with gray circle nodes conesponds to the 
code used at S, and the upper protograph with dark circle nodes corresponds 
to the code used at R. The lower and upper protographs will be connected at 
D for jointly BP decoding. The channel parameters of the gray circle nodes 
are eso and those of the dark circle nodes are erd. 
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Fig. 5. Achievable erasure probability region of spatially-coupled 

protograph-based (3,6, 128)-regular LDPC codes at S and R. The black dashed 
line represents the theoretical limit Eq. (T} for design rate 0.4921875 and the 
gray dotted line represents the theoretical limit Eq. (T) for rate 0.5. There still 
remains a small gap in the slope region for 0.5 < erd < 1, 0.5 < eso < 1- 
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D. Spatially-Coupled Pmtograph-based (I, r, g, L)-MN Codes 

The joint base matrix of the spatially-coupled (4,2,2,128)- 
MN codes at D is given as 



B 



gMN(4,2,2) gMN(4,2,2) 



[0,127] 
I" 

■^128X384 
110 
2 111 
10 11 

2 



10 
1 



[0,127] 
I" 

^128X384 
... 1 









1 








1 


1 


1 





1 


1 








2 

















1 



(7) 



where Ii28x384 ^'^^ ^ "^^^ matrix whose (j, 3j)-th entry is 
1 and the other entries are 0. These 3j-th columns correspond 
to information bits. Note that the indices of matrices start from 
0. The left 384 columns and the other columns correspond x 
and x', respectively. Therefore ej = ego if j = 3i + 1, 3i + 2 
for t = 0, . . . , 127, e'j = if f = 3t + 1, 3i + 2 for t = 
128, . . . , 255, and e^., = 1 if j" = 3t for i = 0, . . . , 255. We 
compute achievable erasure probability region using density 
evolution with B as shown in Eq. (|7]i. 

Figure |8] shows achievable erasure probability region of 
spatially-coupled (4,2,2, 128)-MN codes at S and R. The design 
rate i?MN(4,2,2,i28) jg 0.49609375. As L goes to infinity, 
^MN(4,2,2,L) converges to 0.5 as shown in Eq. Q. The black 
dashed line represents the theoretical limit for rate 0.49609375 
and the gray dotted line represents the theoretical limit for 
rate 0.5. At the corner point = 1 (esd ~ 1), Csd = 0.4999 
(erd = 0.4999) is almost equal to the point-to-point Shannon 
limit of rate one half codes. The boundary of the achievable 
region is very close to the theoretical limit. However there is 
a very small gap less than 10^"* between the boundary of the 
region and the theoretical limit. This gap is due to wiggles 
10. 

VI. Conclusion 

We have designed spatially-coupled protograph-based 
LDPC and MN codes for erasure relay channels. It is ob- 
served that spatially-coupled protograph-based MN codes ap- 
proach the theoretical limit. We expect that spatially-coupled 
protograph-based MN codes approach the capacity over the 
relay channels also with other channel impairments, such that 
the binary symmetric relay channels and the Gaussian relay 
channels. 

In the future work, we propose spatially-coupled 
protograph-based MN codes for Gaussian relay channels 
and prove the rate achievability of the spatially-coupled 
protographs-based MN codes to the theoretical limit. 
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